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Description 

1 . The Field of the Invention 

s [0001] The present invention relates to the field of network communications. More specifically, the present invention 
relates to the real-time communication of multimedia infomnation over heterogeneous networks. 

2. The Related Art 

10 [0002] Multimedia information includes Infonnation that is efficiently interpretabie by one or more of the five human 
senses, but mostly by the human senses of sight and hearing. For example, video information is interpreted by the 
senses of sight and heating. Audio Infonnation is interpreted by the sense of hearing. Some user interfaces such as 
Braille displays present information for interpretation by the sense of touch. IHowever, with the advancement of appro- 
priate user interfaces, multimedia infonmatlon may also include taste and smell information as well. 

IS [0003] Often, multimedia information is time-sensitive and shou Id be rendered at the same speed that the information 
Is sampled within some minimal jitter tolerances. This type of multimedia presentation wilt often be refenred herein as 
"real-time". For efficient real-time delivery of multimedia data, the networics between the multimedia source and the 
multimedia sink should be abstracted so that the networks as a whole fun^ion as a constant delay network. 
[0004] Figure 1 illustrates a conventional network 1 00 for delivering multimedia data In real-time. A multimedia source 

20 101 transmits multimedia packets 104 over a constant delay network 103 to a multimedia sink 102. Of course, there 
is always some variance In the delay, however small. Introduced by any network. However, a "constant delay" network 
is a networi< in which the delay variance introduced by the network is below the minimal jitter tolerances required to 
support real-time presentation of the multimedia data. 

[0005] As illustrated in Figure 1. the constant delay network 103 may include a number of different network types 
25 that follow different standards. Nevertheless, in order to support real-time multimedia data delivery, each component 

network must support the abstraction of the networks as a whole Into the constant delay network. There are generally 

two classifications of networks that support this kind of abstraction into an amalgamated constant delay network. 

[0006] One such classification is constant delay networks. Thus, for example, the constant delay network 103 of 

Figure 1 Includes a component constant delay network 105. Constant delay networics receive multimedia data from a 
30 point on the network at a certain receive rate, and deliver the multimedia data to another point on the networtc at the 

same rate so that there is a relatively constant delay. A second such classification is variable delay networks that have 

a common notion of time. 

[0007] It is possible even in such variable delay networics to emulate a constant delay network If the network supports 
a common notion of time across the networtc. For example, the IEEE 1394 serial bus Is not inherently a constant delay 
35 networic. However, the IEEE 1394 serial bus does support a common notion of time. The lEC 61883-x standard uses 
the common notion of time present in the IEEE 1394 serial bus to have the IEEE 1394 serial bus emulate a constant 
delay network to within the jitter tolerances required under the MPEG-2 standard, 

[0008] Refen-ing to Figure 1, the constant delay network 103 also may include a variable delay network 106. if a 
series of one or more contiguous variable delay networks is interposed between the multimedia source 1 01 and the 
^ multimedia sink 1 04, the series of variable delay networks may emulate a constant delay network if the string of variable 
delay networks shares a common notion or reckoning of time. 

[0009] Thus, conventional methods allow for the real-time delivery of multimedia data over a networic that includes 
both constant delay networks and variable delay networks that have a common notion of time. However, there is a 
third classification of networks that Is not compatible with being a component network in an amalgamated constant 
delay network under conventional standards. That third classification is a variable delay network that does not have a 
common notion of time. 

[0010] Under conventional technology, real-time communteation of multimedia data is not possible if one or more of 
the networics that must be traversed are variable delay networics that do not have a common notion of time. Acscordingly, 
there exists no conventional infrastructure for seamlessly communicating multimedia over heterogeneous networks In 
50 real-time since those heterogeneous networks may include one or more variable delay networks that contain no com- 
mon time reference across the network. Establishing such an infrastructure would allow for better access to multimedia 
content regardless of the heterogenic nature of the networks that intervene between the multimedia sourc^e and the 
multimedia sink. 

S5 SUMMARY OF THE iNVENTION 

[0011] The present invention extends to the real-time communication of multimedia data over heterogeneous net- 
worics that may include constant delay networks, variable delay networks that have a common reckoning of time, and 
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variable delay networics that do not have a common reckoning of time. Currently, real-time communication of multimedia 
data may be accomplished point-to-point over specific networks. However, there Is no conventional way of communi- 
cating such data in real-time over heterogeneous networks that include variable delay networks that have no common 
reckoning of time. 

5 [001 2] If there are any variable delay networics in the heterogeneous networks in which there is no common reckoning 
of time, a common reckoning of time is established in each of those networks. Then, the variable delay networks are 
emulated as one or more constant delay networks using the specifk: common time reckoning present In each variable 
delay networic. Thus, the principles of the present Invention allow for the real-time communication of multimedia Infor- 
mation over heterogeneous networks. By so doing, a user may more flexibly access multimedia data in real-time re- 

10 gardless of the location of the individual. 

[0013] In one aspect of the present Invention, a constant delay networic Is emulated over a variable delay networic 
despite the fact that the transmitter includes a transmitter application that interfaces with a link layer device driver over 
a variable delay interface. The transmitter application provides multimedia packets for transmission over the variable 
delay networic. In addition, the transmitter application provides the multimedia packets with time stamps that represent 

IS the time ac(x>rding to the reckoning of the transmitter applteatton. When the transmitter link layer devtee receives the 
multimedia packet, it csalculates a new time stamp that is in accordance with a network time base, the new time stamp 
being based on the time stamp provided by the transmitter application. The receiver link layer controller then uses the 
new time stamp to evaluate the rendering time of the corresponding information in the packet. 
[0014] Another aspect of the Invention pemrilts for communication over a variable delay networic that does not inher- 

20 ently have a time base. Instead, the transmitter application periodically transmits a current time to various receiver 
devic^es on the networic in order to synchronize the device on the network. Then, the transmitter includes a time stamp 
that follows the synchronized time in order to pemiit the infonnation in the multimedia packets to be presented at the 
appropriate time. 

[0015] Additional features and advantages of the invention will be set forth in the description, whk^h follows, and in 
25 part will be obvious from the description, or may be learned bythepractk^e of the invention. The features and advantages 
of the invention may be realized and obtained by means of the Instruments and combinations particularly pointed out 
in the apperuied claims. These and other features of the present invention will t>ecome more fully apparent from the 
following description and appended claims, or may be learned by the practk:e of the Invention as set forth hereinafter. 

30 BRIEF DESCRIPTiON OF THE DRAWINGS 

[0016] In order that the manner in which the above-recited and other advantages and features of the invention are 
obtained, a more particular description of the inventk>n briefly described above will be rendered by reference to specific 
embodiments thereof, which are illustrated, In the appended drawings. Understanding that these drawings depict only 
35 typical embodiments of the invention and are not therefore to be considered to be limiting of its scope, the invention 
will be described and explained with additional specificity and detail through the use of the accompanying drawings in 
which: 

[0017] 001 7 Figure 1 schematically Illustrates a constant delay network that supports real-time multimedia commu- 
nication in accordance with the prior art; 
40 [0018] Figure 2 Illustrates an exemplary system that provides a suitable operating environment for the present in- 
vention; 

[0019] Figure 3 schematicjally illustrates multimedia c:ommunteatlon over a heterogeneous networic that may include 
constant delay networks, variable delay networks with a common network time base, and variable delay networks 
without a common networic thne base; 
^ [0020] Figure 4 illustrates a flowchart of a method of performing constant delay communication of multimedia pac^kets 
over a heterogeneous network; 

[0021] Figure 5 illustrates the heterogeneous network of Figure 3 in which the variable delay networks that did not 
have a common network time base are provided with a common network time base; 

[0022] Figure 6 illustrates the heterogeneous network of Figure 6 In which the variable delay networks emulate 
so constant delay networks using the common network time base; 

[0023] Figure 7 illustrates a variable delay networic in which there Is an undedicated variable delay interface between 

the transmitter applteatlon and the transmitter link layer <x>ntroller as when the variable delay interface is a PCI interface; 

[0024] Figure 8 illustrates a method for emulating a constant delay network in a variable delay networic even if there 

is a variable delay interface between the transminer application and the transmitter link layer c^ontroiler; 
55 [0025] Figure 9 illustrates a variable delay network in which a cximmon time base is established; and 

[0026] Figure 10 illustrates a method of emulating a constant delay networic using a variable delay network that is 

not conventionally equipped with a common network time base. 
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DETAILED DESCRIPTION OF THE INVEWTIOW 

present Invention extends to the real-time communication of multimedia data over heterogeneous net 

vanab le delay networks that do not have a common reckoning of time. If there are any variable delay neS«,^ whteh 
mere is no common reckoning of time, a common reckoning of time Is establishedln each of thSe S3Ss ??en 

5S «"*o<?""ents of the present invention may comprise a special purpose or genefal-purpose processina 
h!^i^? "'i r*""*""^ r"""^ '^^^''^^^^ components, as discuLd in greater dC^S^tew^?^ 

S!^^^ 'T^' '^'^'1^ "'""'P'^ « "^^o*^'' environment Set top box^TS enha^ 

he capab.lrt,es of conventional televisions represent an example of a special puqjose compute? ^ 

t*'* scope of the present invention also include computer-readable media for carrying or 
having computer-executable instnjctions or data stmctures stored thereon. Such computer-readable m^teTn be 

IJSSretrd'thS S7h" 'I':"" '^"'^ """"^ °' computer-executable InstSons o^S 

20 fi^^'*®^'^**'**^"*»®^«^®**''y« several purpose or sp^^^^ 

r-H i?" is transferred or provided over a network or another communications connection (either 

handwired. wireless, or a combination of hardwired or wireless) to a computer, the computer preperly "tews the Sn- 
necfon as a computer-readable medium. Thus, such a connection Is also pre^rty temied a ^Zr^re^daSle me 
d.um. Combrnations of the above should also be Included within the scope of coriputer^eadrbrm^ircomo^^^^^ 
executabte,n8truc«onscomprise.forexampte.lnstmctkH« and data Which causeagenera^^^^^^^^^^ 
pujose ~niputer. or special purpose processing device to perfom, a certain functL or greup of fu^S 
tOWl The invention wHI be described in the general context of computer-executable InSmctlons. suc^ as' program 

objects^ components, data structures, etc. that perfomi particular tasks or rmplement partteular atetraJdate ,^s" 
The sequence of instructions implemented In a particular data structure or program module repre7ente eSmo^s of 
corresponding acts for implementing the functions or steps described herein represents examples of 

™L ?T 5 f."*^ *® °°'^««P°"'l'"g discussion are intended to provide a general description of a suitable envi- 
s^Z h«t k'^ '"^^ implemented. In the discussion. refereSce is made to a hoi entSternZt 

""^^ ! "^^'^ '"^'"^y'"^ '^"^'"9 pregramming. For purposes of this de^ripZ aS in the 

dLv^ w„ T'' ^ent system" may be a display unit, such as a teleSlston screen, cou^d ?o a pr^eL Sa 

consumer electronte devtees. one of which having a processing device for perfom^ing the data precessingTs^Sed 

f'f^P'es of such consumer electronic devices include a video cassette recorder ("VCR") a video aame 
Sflr- ^ °' processing capabilities, a cabte tetevislo'n box ^ diS 

almiSk r^dT:'^^^^ ^ ''-^^^^n^ -^^-^ ("DVB"), a digial versatile dfeJ^Jstm ("OvJ^ 

devre^a«wlT 

3nZt^d^ a te^S^^rLr^^^ ^1"*"' ^"'*^«'-<'-. •''^ tern, "home entertainment system's ^be 

in fvSs^omHt alr„?H T"^^^ a television-viewing or musk: listening environment, whether it is located 
»nrt Tn r f !: P ' business, in the public, or at any other location. Also for purposes of this descriotlon 

aXt:S'Se^nrnrar"'"^ 

S^I ^ll^^ T^,°'^^T' "'^ P'^®"* implemented in a system that uses a conventional television 

screen or other display unit to display infomiation and includes a WebTV® set-top box or a^^Zt^^l^n^, 

SodS^d: We^STb? r°'" '^^:P-«"°- •-"'^^ --Po^-n^. sending''a'nd^:LM:S^:LTb^^^^^^^^ 

te^nrmL ^e ZnSi;^^^^^^ ^"'^ "'^^'^^^ «*«P'«y'"g infom,ation. An IntLet 

Jith r^wTfi^ use standard telephone lines. Integrated Services Digital Networtc (ISDN) lines, cabte lines associated 

Fi^rS m "'^ *° °^ "^"^^^ network^- 

S^ci H ^"^^^ ^ """"^ entertainment system 210 that includes a management system 212 a display 

device 214 and an audio system 216. IVIanagement system 212 may be a set-top box or Inter^eT^rmiSl th^hS 
been adapted to perfom, the operations disclosed herein. Management system 212 may be inTJSSllv ^SLittn^^^ 

3el£ri^«w?^^''"?'^'°" ^" '"'^"''^ ""''^ stimulation, a computrmoniSr or any o*er 

devK«capabte Of drsplayrngviewabte video image data. Audtosystem216maybeaspeake,astereos;st^^^^ 
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device capable of emitting sound data, and similarly may be integrally positioned with or separate from display device 
214. 

[0036] Management system 21 2 Includes a signal input 21 8, which receives programming from a signal source 220. 
The programming Is transmitted from signal source 220 to signal input 218 via a programming Input line 222, which 
5 can be a cable or optic connection, a terrestrial antenna system, a satellite system, or any device or system capable 
of transmitting programming to home management system 212. 

[0037] The signal source 220 may be either a single channel signal source or a multiple channel signal source. A 
single channel signal source provides programming from a recorded medium, such as a videocassette, compact disc, 
etc. Examples of a single channel signal source Include a VCR, a DVD, and the like. Alternatively, a multiple channel 
10 signal source includes any system or device that is capable of sending a signal that may be received by a satellite 
receiver, a cable or optic connection, a ten-estrial antenna, or the like. Examples of a multiple channel signal source 
Include DSS/DVB, a cable box, locally broadcast programming (i.e. programming broadcast using UHF or VHP), and 
the like. 

[0038] While Rgure 2 Illustrates home entertainment system 21 0 as having a single programming input line 222 and 
15 a single signal source 220, there may also be a plurality of programming input lines that transmit programming from a 
plurality of signal sources. In such embodiments, the home entertainment system may receive the programming from 
one signal source or from a plurality of signal sources at a time. 

[0039] Management system 21 2 also includes a user input interface 224, which receives input from an input devtee 
226, such as a remote control, external special purpose or general-purpose processing devk» or computer, keyboard, 
mterophone, mouse, or any other device capable of generating electrons instructions for management system 212. 
Input devtee 226 is communicatively coupled to management system 21 2 over an input link 228 so as to enable such 
control. Input device 226 generates electrons Instructions over input link 228 in response to preprogrammed data or 
in response to a viewer pressing buttons on input device 226, Input device 226 may also control Web browser software 
within management system 212 as when management system 212 is a set-top box or an Internet terminal that has 
?5 been adapted to perform the operations disclosed herein. For instance, input device 226 may be programmed to tum 
on home entertainment system 210 and to tune management system 212 to a channel. 

[0040] Figure 2 Illustrates a signal recorder 230, which Is capable of receiving video and/or audio data and recording 
the data on a storage medium. Video signals are transmitted to display device 214 and/or signal recorder 230 by video 
Image links 232a and 232b, respectively, examples of which Include a radio-frequency ("RP) link, an S-video link, a 
?o composite link, or any other equivalent fomi of video image link. Similarly, audio links 234a and 234b transmit audio 
data from management system 212 to audio system 216 and/or to signal recorder 230. 

[0041] The operation of management system 212 is controlled by a central processing unit ("CPU"), Illustrated as 
processing unit 236, which Is coupled to an application-specific integrated circuit ("ASIC") 238 via system bus 240 and 
uses computer-executable instructions Implemented In software and/or hardwired logic circuitry. Processing unit 236 

w and ASIC 238 are also coupled via a system bus 240 to various other system components. Including system memory 
242, mass storage interface 244, user interface 224 and signal input 218. Processing unit 236 may execute software 
designed to Implement features of management system 212 Including features of the present invention. 
[0042] ASIC 238 contains circuitry that is used to implement certain functions of management system 212. Instruc- 
tions, data, and other program modules necessary for the operation of processing unit 236 and necessary for the 
operation of the ASIC 238 may be stored in mass storage device 250 and/or system memory 242, whteh includes read- 
only memory ("ROM") 246 and random-access memory ("RAM") 248, System memory 242 is coupled to system bus 
240 and mass storage devtee 250 is coupled to mass storage interface 244, which Is In turn also coupled to system 
bus 240. Thus, ROM 246, RAM 248 and mass storage device 250 are communicatively coupled to ASIC 238 so as to 
be readable by ASIC 238 and so that data may be written from ASIC 238 to RAM 248 and to mass storage device 250. 

s Mass storage device 250 may be a magnetic hard disk 252, but may also be any of the other computer-readable media 
referenced above. 

[0043] Any desired computer-readable instructions or data. Including application programs 254, other program mod- 
ules 256, and an electrons programming guide ("EPG") 258. whfch specifies the broadcast times and channels of 
programs can be stored in mass storage device 250. 
o [0044] Mass storage device 250 may also be used to record video data 253. in whrch case, management system 
21 2 perf omis the functions of a digital video recorder. Digital video data may be received by home entertainment system 
210 from a variety of sources including signal source 220, remote computer 260, video game 268, Input devtoe 226 
and the Internet. 

[0045] EPG data maybe obtained In a variety of manners. For Instance, the EPG data can be supplied to management 
5 system 212 by a remote computer 260, such as a server, or from devices on the Internet and stored on mass storage 
device 250. The EPG data may be supplied on a regular basis to continually maintain a current schedule of programming 
at the management system 212. Altematlvely. the EPG may be delivered to home entertainment system 210 by using 
a direct-dial communteation over standard telephone lines, or by using data transmission over the cable television 
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infrastructure, a satellite network, an over-the-air broadcast or any other available medium, Including those previously 
mentioned. 

[0046] In the embodiment where management system 212 Is associated with the Intemet, management system 21 2 
may communicate with remotecomputer260 via wide area network ("WAN") 262 usinga variety of techniques, including 
5 interposing serial port Interface 264 between the system bus 240 and a modem 266, using a wireless link, or other 
means for establishing communications over a WAN that may be internal or external to management system 212. 
Management device 212 is also capable of transmitting information via the Intemet by direct-dial communication over 
standard telephone lines, or by using any other available communication medium. 

[0047] While serial port interface 264 may be utilized to connect a modem 266 for communicating across a WAN, 
10 serial port Interface may also be utilized to connect other consumer electron to devices, such as video game 268, and^ 
or various input devices, such as a keyboard (not shown) or joystick (not shown), to management devtee 212. 
[0048] Referring now to signal input 218, if the signal on programming input line 222 includes multiple channels, a 
tuner 270 included in signal input 218 tunes to a selected channel in the signal. Multiple tuners 270 can be used to 
provide enhanced viewing features, such as picture-in-picture, recording one channel while viewing another, and re- 
's cording a pluralify of channels simultaneously. A signal decoder 272 may convert video data from an analog fomiat to 
a digital format, from a digital fonnat to an analog fomnat, or convent between varying digital fomiats, In the event that 
ASIC 238 and tuner 270 employ different formats. Video decoder 272 may also decode video data from a compressed 
video fomnat (e.g. MPEG). In embodiments where the management system 212 includes multiple tuners 270, man- 
agement system 212 may also include multiple signal decoders 272 to perform the operations disclosed herein. 
20 [0049] Management system 21 2 may also include video output 274, which may include a video converter that switch- 
es between analog and digital fonnats as necessary when providing video data over video links 232a and 232b. Slnn- 
llariy, audio output 276 can include an audio converter to provide the necessary switching between analog and digital 
formats across audio links 234a and 234b. 

[0050] While Figure 2 and the corresponding discussion above provide a general description of a suitable environ- 
25 ment in which the invention may be implemented, it will be appreciated that the features of the present invention 
disclosed herein may be practiced In association with a variety of different system configurations. 
[0051] Figure 3 illustrates a networic 300 in whtoh a multimedia source 301 communicates a plurality of multimedia 
packets 304 over heterogeneous networks 303 to a multimedia sink 302. The wide area network 262 described above 
with reference to Figure 2 is one example of a heterogeneous network, with the multimedia source 301 being the 
30 remote computer 260, and the multimedia sink 302 being the home entertainment system 21 0. However, the multimedia 
sink 302 may also be a personal digital assistant, a lap top computer, a desk top computer, a telephone, or any other 
device capable of receiving multimedia packets and rendering in real-time the associated multimedia information. 
[0052] The heterogeneous networics 303 may include three classifications of networks as follows: 

55 1) constant delay networks 

(e.g., constant delay network 311); 

2) variable delay networks that have a common time base 

(e.g., variable delay network 312 that has common time base 322); and 

3) variable delay networks that do not have a common time base 

^ ((e.g., variable delay networi< 31 3 that does not have a common time base). 

[0053] Although the heterogeneous networi<s 303 are illustrated as having only one of each ciasslftoation of networks, 
the principles of the present invention may be applied to heterogeneous networks that have zero or one or more of 
each classlfteation of networks. The heterogeneous networks are illustrated such that multimedia packets 304 would 
traverse, in order, the constant delay network, the variable delay network with a common time base, and the variable 
delay networic without a common time base. This configuration is provided for illustrative purposes only. The principles 
of the present invention apply regardless of the specific order of each network within the routing path of a multunedia 
packet. 

[0054] In order to transition the multimedia packets from one network to the next, a gateway is provided between 
50 each network In the heterogeneous networks. For example, gateway 331 receives multimedia packets from constant 
delay network 311 , perfomris appropriate functions on those packets as described herein, and provides those packets 
over the variable delay network 31 2. In addition, gateway 332 receives multimedia packets from variable delay networi< 
312, performs appropriate functions on those packets as described herein, and provides those packets over the variable 
delay network 313. The gateways receive multimedia packets from a previous network, reconfigure the multimedia 
55 packet if necessary to confonn to the standards of the next network, and then transmit the potentially reconfigured 
multimedia packet onto the next network. 

[0055] Figure 4 illustrates a method 400 of performing constant delay communication of a stream of multimedia 
packets over heterogeneous networks in accordance with the present invention. Figure 3 illustrates an initial state of 
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the heterogeneous networks before the method of Figure 4 commences. Figures 5 through 6 show successive states 
of the heterogeneous networks that result from the perfomiance of the method of Figure 4. Accordingly, the method 
of Rgure 4 will be described with frequent reference to the network states Illustrated In Figures 3, 5 and 6. 
[0056] Initially, a common time reckoning is established In those variable delay networks In the heterogeneous net- 

5 works that do not already have a common network time base (act 401). Figure 5 illustrates the network state of the 
heterogeneous networks after act 401 Is complete. The modified forni of the heterogeneous networks 303 of Rgure 3 
are illustrated as heterogeneous networks 603 in Figure 6. The modified fomri of the variable delay network 313 of 
Figure 3 Is illustrated as variable delay network 513 in Figure 5. Note that variable delay network 513 has a common 
time base 523, whereas the variable delay networic 313 does not. At this stage, each of the networks In the heteroge- 

10 neous networics 503 should either be a constant delay network, or a variable delay networi< that has a common networic 
time base. 

[0057] Returning to method 400 of Figure 4, the variable delay networks are emulated as one or more constant delay 
networks using the common tfrne reckonings followed by each variable delay networtc (act 402). This may be accom- 
plished by the link layer, the application layer or another layer In the gateway including a time stamp In the multimedia 

IS packet, the time stamp representing a time that follows the common time reckoning of the next variable delay networtc. 
The time stamp may be related to the time that the packet Is to be rendered and may be, for example, the time that 
the packet Is transmitted. The receiving device may then use the time stamp to detemiine when the packet should be 
displayed. The time stamp may also be used to detennlne what time the multimedia packet should be transmitted by 
subsequent gateways, or perhaps what time future time stamps should Indicate for subsequent networics. Referring 

20 to Figure 5, the common time base 322 of the variable delay networi< 31 2 Is used to emulate the variable delay networi< 
312 as a constant delay networic. In addition, the common time base 523 of the variable delay networi< 513 may be 
used to emulate the variable delay networi< 51 3 as a constant delay network. 

[0058] Figure 6 Illustrates the network state of the heterogeneous networks after act 402 is complete. The modified 
form of the heterogeneous networks 603 of Figure 5 are illustrated as heterogeneous networics 603 in Figure 6. The 
emulated constant delay network 61 2 replaces the variable delay networic 31 2 to emphasize Its constant delay emu- 
lation. In addition, the emulated constant delay networic 613 replaces the variable delay networic 513 to emphasize Its 
constant delay emulation. Now the network Is sufficiently prepared to transmit multimedia packets from the multimedia 
source and the multimedia sink (act 403) in real-time. 

[0059] As a multimedia packet transitions from one networtc to the next In the heterogeneous networks, the gateway 
30 may refonnat or reconfigure the multimedia packet to confonn with the requirements of the next networic if necessary. 
In some cases, this may involve including a time stamp that confonns to the format of the next network and that 
represents an accurate time according to the time reckoning of the next network. Such time translation need not oc»ur, 
however, if both the previous networic and the next networic recognize the same time reckoning, or if the next networic 
Is a constant delay network. 

35 [0060] When transitioning from a constant delay network to a constant delay network, the gateway should ensure 
that the packet Is transmitted onto the next network at a relatively constant time period after the packet was received 
from the previous network. This transition may be accomplished without interpreting, manipulating, or creating time 
stamps for the packet 

[0061] When transitioning from a constant delay network to a variable delay network, the gateway will receive the 
packet at a given receipt time from the constant delay networtc. The gateway will then generate a time stamp that 
represents a time according to the common time reckoning of the variable delay network, the time being equal to or 
having a relatively constant offset from the time that the packet was received from the constant delay network as 
measured using the <H>mmon time reckoning of the variable delay network. 

[0062] When transitioning from a variable delay network to a constant delay network, the gateway will receive the 
packet and Interpret the time stamp according to the time reckoning of the variable delay network to determine the 
time (according to the time reckoning of the gateway) when the packet should be transmitted onto the constant delay 
networic. The gateway will then transmit the packet onto the constant delay networic at the given transmit time. 
[0063] When transitioning from a variable delay networic to another variable delay networic, the gateway will leave 
the time stamp in the multimedia packet If both variable delay networks follow the same time reckoning and packet 
format. Otherwise, the gateway will translate the time stamp so that it represents a time according to the corrvnon time 
reckoning of the second variable delay networks. 

[0064] In some variable delay networics, there Is no provision for a link layer controller to maintain a common reck- 
oning of time with other devtees on the network. Accordingly, the application layer Itself may maintain the common time 
reckoning across the devtees, calculate the appropriate time stamp, and/or Include the time stamp in the multimedia 
packet. Which of these tasks the application layer performs may depend on the capabilities of the link layer that the 
application layer uses to forward multimedia packets through the gateway. 

[0065] In this manner, even heterogeneous networics may emulate a constant delay networic that allows for real-time 
communication of multimedia packets. Thus, the principles of the present invention provide for the delivery of multi- 
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media packets regardless of the heterogenic nature of the networKs that Intetvene between the multimedia source and 
the multimedia sink, even if some of the heterogeneous networks include variable delay network that do not themselves 
support a common notion of time. Thus, streaming multimedia data may be available regardless of the kication of the 
user. Accordingly, the principles of the present invention represent a signifteant improvement over the state of the art 
[0066] Venous examples are now provided of howto emulate a constant delay network from a variable delay network' 
In partteular. Figure 7 illustrates a network configuration 700 that includes a transmitter 720 and a receiver 721 and a 
vanable delay networi< 704 that intervenes between the transmitter 720 and the receiver 721 . 
(0067J The transmitter 720 Includes a transmitter application 701 that stores a plurality of multimedia packets in a 
memory 707. For example, memory 707 stores two multimedia packets, a first multimedia packet 708 and a second 
multimedia packet 709. The transmitter 720 also includes a transmitter link layer controller 703 that actually retrieves 
the multimedia packets for transmission overthe variable delay network 704. A variable delay Interface 702 intervenes 
between the transmitter applteatton 701 and the transmitter link layer controller 703. The receiver 721 includes a link 
layer controller 705, whteh receives the multimedia packets from the variable delay networic 704 and provides those 
packets to the receiver application 706. 

[00681 The variable delay network 704 may be. for example, an IEEE 1394 serial bus networic It should be noted 
that the conventional lEC 61 883-x technology allow for constant networic emulation of a IEEE 1394 serial bus networit 

using anAVIinklayercontrollerthatprovkleslEC61883-x8upport.However. this conventionalconstant delay emulation 
relies on a constant delay between the transmitter application dispatching the multimedia packets, and ttie transmitter 
link layer controller receiving the multimedia packet. However, as illustrated in Rgure 7. there is a variable delay inter- 
face 703 between the transmitter application 701 and the link layer controller 703. Therefore, there is no reason to 
believe ttiat the conventtonal constant delay emulation methods using an AV link layer controller that provides lEC 
61 883-x support would woric in the networic conflguration illustrated in Figure 7. 

[0)691 The variable delay interface 702 may be, for example, an undedicated PCI interface. In this case, the trans- 
mitter link layer controller 703 may be. for example, an OHCI link layer controller. The PCI interface has the advantage 
of being able to be shared among a variety of devtees, not just the transmitter link layer controller 703. Accordingly, 
the PCI interface is well suited for general purpose computing systems. However, conventional technotogy does not 
provide for constant delay networic emulation of a variable delay networic when the transmitter of the variable delay 
networic includes a variable delay interface between the transmitter applteation and ttie transmitter link layer controller 
The pnnciples of the present Invention, however, allow for a PCI interface with an OHCI link layer controller to be used 
in a transmitter while still emulating a constant delay network. 
[0070] Figure 8 Illustrates a method 800 of a transmitter link layer controller emulating a constant delay networic over 
a vanable delay networic despite the undedicated variable delay interface in aocoidance with ttie present inventton. 
Tfte method 800 of Rgure 8 will be described with respect to the networic configuration 700 of Rgure 7 
,« ^^71 ^ ^® transmitter link l^er controller 703 receives a first multimedia packet 708 from the transmitter application 
35 701 (act 801 ). The transmitter applteation 701 included a first transmitter application time stamp 71 0 in ttie packet the 
time stamp 710 representing ttie relative time that the infomiation in the first multimedia packet 708 should be rendered 
by the receiver application 706 as represented in the time base followed by the transmtter application 701 The trans- 
mitter link layer controller 703 then includes another time stamp 714 in the first multimedia packet 708 (act 802) The 
new time stamp represents the time that ttie con-esponding informatton should be rendering with reference to the 
network time base. 

[0072] The transmitter link layer controller 703 also receives infonnation from the transmitter applteation 701 from 
which the transmitter link layer controller 703 may derive ttie frequency (act 803) of the time base used by the transmitter 
application wiUi respect to ttie common time base (i.e.. the networic time base) recognized over devtees on the variable 
delay networic 704. The transmitter link layer controller 703 stores this information as frequency 712. and also stores 
the cun-ent time 713 in accordance with ttie common time base recognized over the variable delay networic 704 
[0073] The transmitter link layer controller also receives a second multimedia packet such as multimedia packet 709 
from ttie transmitter application 701 over the variable delay interface 702 (act 804). The transmitter applteation 701 
included a transmitter application Ume stamp 71 1 in the packet, the time stamp 71 1 representing the relative time ttiat 
the infonnation In the second multimedia packet 709 should be rendered by the receiver appiicaUon 706, as represented 
in the time base followed t>y the transmitter application 701 . 

[0074] The transmitter link layer controller 703 ttien calculates a network time stamp 71 5 that represents the relative 
time ttiat the infonnation in the second multimedia packet should be rendered by the receiver application 706 in ac- 
cordance with ttie common networic time base (act 805). The cateulation is based on the first ft-ansmitter application 
tome stamp 71 0, the second transmitter application time stamp 71 1 , the frequency 712, and the first nehworic time stamp 
/1 4. More specif ically, this cateulation may be made according to ttie following formula: 

new.networietime = old_networicjtime + (new_STB_time - old_STB_time) * 
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frequency 



where: 

old_network_tfme = the stored value of the time stamped In the last packet; 
old_STB_time = the stored value of the software time base provided In the last packet; 
5 new_STB_tlme = the value of the software time base read from the current packet; and 

frequency =^ the stored software time base frequency. 
In actual Implementation, a fixed offset may be added to the network time stamps to be In compliance with any applicable 
specification such as lEC 61 883-x. 

[0075] The transmitter link layer controller 703 then Includes the calculated network time stamp 715 in the second 
10 multimedia packet 709 (act 806). and then dispatches the second multimedia packet 709 over the variable delay network 
704 (act 807). The calculated network time stamp 716 may be Included In the multimedia packet In accordance with 
the lEC 61 883-x protocol. The receiver link layer controller 705 may then receive the multimedia packets and Interpret 
the time stamp using the I EC 61 883-x protocol. The link layer controller 705 may then f onward the packets to the 
receiver applteation 706 which may then time the rendering of the corresponding information. 
'5 [0075] Figure 9 illustrates a network configuration 900 In whfch a transmitter application 901 controls the time base 
across a variable delay network 903. The transmitter application 901 Is associated with a transmitter link layer controller 
902 that stores a time base 913. A receiver applteation 905 Is associated with a receiver link layer controller 904 that 
stores a time base 914, that is relatively synchronized with the time base 613. 

[0077] Figure 10 illustrates a method 1000 for emulating a constant delay network over the variable delay network 
^ and will be described with respect to Figure 9. The transmitter link layer controller 902 stores a transmitter application 
time base 913 received from the transmitter application 901 (act 1001). 

[0078] The transmitter link layer controller periodically transmits the transmitter application time base to one or more 
devices including the receiver link layer controller 904 over the variable delay network 903 (act 1002). Software that 
provides data asynchronously to the multimedia packets may perf omi the task of synchronization. In this manner, the 
?5 clock registers at the transmitter and receiver link layer controllers (I.e., the time base 91 3 and the time base 91 4) may 
be kept synchronized. 

[0079] The transmitter link layer controller 902 includes the transmitter application time base in each packet that is 
to be transmitted over the variable delay network (act 1003) and then dispatches the packet over the network (act 
1004). The receiver application 905 may then use the transmitter application time base in order to time the rendering 
w> of the con^esponding infomriation in the multimedia packets. An example of a variable delay network In which the method 
1000 of Figure 10 may be implemented is an lEC 802.11 wireless network. 

[0080] Therefore, the principles of the present invention provide for a means of emulating a constant delay networi< 
even over a group of heterogeneous networics that include variable delay networks that do not iriherently support a 
common notion of time. Also, the principles of the present invention allow for constant delay network emulation on 

» variable delay networks in which there is a variable delay Interface between the transmitter applteatlon and the trans- 
mitter link layer controller, and In variable delay networks that have no Inherent common networic time base. 
[0081] The present Invention may be embodied In other specif te forms without departing from its spirit or essential 
characteristfes. The described embodiments are to be considered in all respects only as illustrative and not restrictive. 
The scope of the Invention Is, therefore, Indicated by the appended claims rather than by the foregoing description. All 

0 changes, which come within the meaning and range of equivalency of the claims, are to be embraced within their scope. 
[0082] What is claimed and desired secured by United States Letters Patent is: 



A method of perfomiing constant delay communication of a stream of multimedia packets from a multimedia source 
over heterogeneous networks including a plurality of variable delay networics to a multimedia sink even though 
one or more of the variable delay networics do not themselves provide for a common reckoning of time in the 
variable delay networic, the method for use in a networic system that Includes the multimedia source and the mul- 
timedia sink, the multimedia source transmitting the stream of multimedia packets to the multimedia sink over a 
plurality of heterogeneous networks, the method comprising: 

establishing a common time reckoning in all of the variable delay networks that do not themselves provide for 
a common time reckoning; 

emulating the plurality of variable delay networks as one or more constant delay networks using the specifk: 
<x>mmon time reckonings present in the plurality of variable delay networics, wherein the heterogeneous net- 
worics as a whole emulates a constant delay network; and 
transmitting a multimedia packet over the heterogeneous networks. 
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2. The method In accordance with Claim 1 , further comprising: 

receiving the multimedia packet from a previous network In the heterogeneous networks; 
as the multimedia packet transitions from the previous network to a next network in the heterogeneous net- 
5 works, configuring the multimedia packet if necessary to conform with the requirements of the next networic if 

the multimedia packet does not already confomi with the requirements of the next network; and 
transmitting the reconfigured multimedia packet onto the next network. 

3. The method In accordance with Claim 2, further comprising: 

10 

repeating the receiving of the multimedia packet from a previous networic, the configuring of the multimedia 
packet if necessary, and the transmitting of the reconfigured multimedia packet onto the next networic for each 
network transition as the multimedia packet traverses the heterogeneous networks from the multimedia source 
to the multimedia sink. 

IS 

4. The method in accordance with Claim 2 or 3, wherein the next networic is a variable delay networic, wherein the 
configuring of the multimedia packet If nec^essary <n>mpri$es: 

generate a time stamp that represents a time in accx)rdance with a common time reckoning of the variable 
^ delay network; and 

including the time stamp in the multimedia packet 

5- The method in accordance with Claim 4, wherein the including of the time stamp in the multimedia packet Is 
performed by the link layer. 

25 

6. The method in accordance with Claim 4, wherein the Including of the time stamp In the multimedia packet com- 
prises: 

including the time stamp in the multimedia packet before control of the multimedia packet transfers to the link 
50 layer associated with the next network. 

7. The method in accordance with Claim 6, wherein the including of the time stamp in the multimedia packet before 
control of the multimedia packet transfers to the link layer comprises: 

an application layer including the time stamp in the multimedia packet. 

8. A method of a transmitter link layer controller emulating a constant delay network over a variable delay networic 
despite an undedicated variable delay interface, the method for use in the variable delay network that includes a 
transmitter and a receiver, a transmitter appllcatlori associated with the transmitter configured to transmit a stream 
of multimedia packets through the transmitter link layer controller, over the variable delay networic. through a re- 
ceiver link layer controller to a receiver application associated with the receiver, the transmitter link layer controller 
having the undedicated variable delay interface with the transmitter applfcation, the transmitter link layer controller 
and the receiver link layer controller being substantially synchronized in accordance with a common networic time 
base, the method cxsmprising: 
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receiving a first multimedia packet from the transmitter appifcatlon, the first multimedia packet including a first 
transmitter application time stamp, which represents the relative time that the Information in the first multimedia 
packet should be rendered by the receiver application in accordance with a transmitter application time base; 
including in the first multimedia packet a first networic time stamp, which represents the relative time that the 
infonnation in the first multimedia packet should be rendered by the receiver application in accordance with 
the common network time base; 

receiving data representing a frequency of the transmitter applfcation time base; 

receiving a second multimedia packet from the transmitter application, the second multimedia packet including 
a second transmitter application time stamp, which represents the relative time that the infonnation in the 
second multimedia packet should be rendered by the receiver application in accordance with the transmitter 
application time base; 

calculating a second network time stamp representing the relative time that the Infonnation in the second 
multimedia packet should be rendered by the receiver application In accordance with the common networic 
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time base, the calculation based on the first transmitter application time stamp, the second transmitter appli- 
cation time stamp, the frequency, and the first network time stamp; 
including the second network time stamp In the second multimedia packet; and 

dispatching the second multimedia packet to the receiver application. ' 

5 

9. The method In accordance with Claim 8, wherein the variable delay network is an IEEE 1394 compliant network, 
the transmitter link layer controller comprises an OIHCl link layer controller, and the undedicated variable delay 
interface comprises a PCI interface. 

10 io. The method in accordance with Claim 8 or 9, wherein including the second network time stamp in the second 
multimedia packet is performed in accordance with the I EC 61883 protocol. 

1 1 . A method of a transmitter emulating a constant delay network over a variable delay network, the method for use 
in the variable delay networtc that includes the transmitter and a receiver, a transmitter application associated with 

15 the transmitter configured to transmit a stream of multimedia packets through a transmitter link layer controller, 

over the variable delay network, through a receiver link layer controller to a receiver application associated with 
the receiver, the method comprising: 

storing a transmitter application time base in a register; 
20 periodically transmitting the transmitter application time base to one or more other devices in the variable delay 

network; 

including a transmitter application time stamp in a multimedia packet, the transmitter application time stamp 
representing the relative time that the infomiation in the multimedia packet shouki be rendered by the receiver 
applteation; and 

25 dispatching the multimedia packet to the receiver application. 

12. The method in accordance with Claim 11. wherein the variable delay network is an IEEE 802.11 compliant network. 

1 3. Acomputer program product comprising a computer readable medium having stored thereon computer-executable 
^ instructions for performing all the steps of the method according to any one of claims 1 to 12, when run on a 

computer. 

14. The computer program product in accordance with Claim 17, wherein the computer-readable medium is one or 
more physical storage media. 

35 
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